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ABSTRACT 

One major problem with designing a long^^term 
evaluation strategy for administrator preparation programs is the 
difficulty of determining adeguate measures of administrative 
success. The most practical approach to developing useful criteria 
seems to be to begin with job descriptions and analyses of actual 
administrative tasks. Of course, a university cannot train future 
administrators to handle every task that will confront them, but such 
an approach insures preparation for at least some of the major 
elements of most administrative positions. He can only build 
long*range evaluation into nev models of administrator preparation if 
the models are based on careful anal.yses of inservice administrative 
behaviors vith which the university is competent to fleal. The content 
validity of the preparation is then assured and long-range evaluation 
simply requires updating job analyses and comparing them vith current 
training programs. (Author/J6) 
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Building Long Ivangc Evaluation into New Models 
cf Administrator Pi*eparation 

The phrase has a nice ring to it, largely because of two comfortaMe 
elements: "new nwdels" -- v^t educator's heart doesn't beat faster in 
anticipation of anotlier new iijodel of administrator preparation? Tliat phrase, 
and the plans and hopes that accoiT.pany it, liave stirwlated articles and 
conf ei'ences as well as contributed to paying overhead in departiients 
of administration tliat are skilled in the arts of grantsinansliip. 

Even more attractive tlian the term "new models" is "long range 
evaluation". Tliat 's the kind of evaluation we caii best live with the 
longer range, the better 1 If survival were a primary goal of an educational 
administration department cliairmen he might turn to the criterion study 
model for long range evaluation of his department's program. First, 
goals and objectives Kuist be established for the program. Our survival- 
minded cliaimian will, of course, rely on a committee to come up with tlie 
department's goals and objectives. The coraniittee may, in the fullness of 
time, agree on a report. All tliose with a conceivable interest in the 
subject -- department, faculty, students, graduates, colleagues in other 
areas tiien add to tiie list of department goals. The next step is a 
review of tlie present program to insure that at least some of the departments* 
students are being given the opportunity to learn \Amt the facult)^ et al., beli 
they ought to know. It's a safe bet that the goals and objectives will be 
couclied in a manner tliat allows for quite different training programs. Records 
of students who experience each training program sliould be placed in a tijr^ 
capsule and uncovered some 5-10 years hence. Do those in training program A 
sIiDW significantly greater success tlian those in program X? Do tliose 
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vflio ranked Idghcst in Program A show significantly greater success in 
practice tlian tlieir lower scoring brethren in the same prcgram? 

The criterion validity niodel for long range evaluation lias a rather 
respectable look about it at first glance, and the liiatus between 
treatment and design may allow tlie department chairman to reach retirement 
in relative peace. But whatever tlie at<-.raction of the model just outlined, 
it really makes no sense at all for evaluating educational administration 
programs . 

Long range evaluation of admiiiistrator preparation almost seems 
an illusion. The best criterion — success in practice is subjective, 
mobile and highly situation-dependent. Subjective, since indicators like 
salary, rarJc, collegial esteem, etc., are not equally valued nor equally 
available to sijiiilarly prepared graduates. Tne concept of the successful 
administrator sinply won't stand still: at least ever>' generation of scliool 
adirinistrators receives a new criterion of success. Authoritarian or 
democratic, mcinager of work or mediator of interpersonal relations, each 
presents a new definition of the successful ndiiinistrator. Success — 
however defined -- depends strongly on the adiidnistrative environment. The 
superintendent who was great in Littleburg is a disaster in Metropolis. 
Tlie principal who received rave notices from parents is branded, 10 years 
later, as insensitive, ineffective, and urwelcome by parents of a different 
etlmic or racial background, 

Tlie thought of standardizing several distinct training programs to 
insure each student in a given program essentially the s^ie learning experiences 
must engender wry a:iTUsement among department chairman • - the individualism cf 
faculty members needs no comment. Add to the variations among instructors 



the lack of dlscrixiination in student grading procedures and tliere appears 
to be no stable base for coriducting long range criterion evaluation of 
administrative training programs, 

Tlie potential Icng-rarge ©valuator's life isn't made easier by tlie 
distinctions that exist in sources of judgement. We want to speak most 
often about product evaluation - the actual functions of the educational executiv 
- as the major criterion. But tlie preparing institution has a 

set of objectives tliat may not always overlap or be consistent with practitioners 
activities. Hieoretically, the tiiree commonly iis^d factors to evaluate 
faculty - teadiing, research and service - should all relate to student 
outcomes. In fact, such relationsJiips may be so subtle as to be unverifiable. 
Do tliey then beccne invalid, or must the faculty justify its existence and 
its fimctions against the standard of administrative practice? 

Any model of administrator preparation iiust somehow come to terms vdth 
tlie variations anK^ng students, tlieir reasons for entering, and commitment 
to the preparation prograir^. Tliere are full time candidates for the doctorate, 
with some ini-titutions holding different expectations for those seeking the 
Ph.D or Ed.D. Many adiainistration doctoral students work in quite demandirig, 
full-time positions, especially during the period they are vn*iting their 
dissertations. Tlie majority of administration students are part-time attendants 
their motives and objectives may radically differ from full-time students. 
It's possible too tliat by seme success criteria, e.g., level of job or 
salary, tlie name of tJjc university granting the degree is vastly more 
poweTxul tiian tJie nature or quality of a prcgrara, or an individual's 
achievement \dtliin t-iat program. It's at least equally conceivable tliat 
recruitment and selection in educational administration programs is tlie really 
pov/erfiil determinant of future success. 



Itiving progresscKl tliis far into wliat seens tin evaluation is'asteland, 
1*11 now suggest tl:at there exists over tlie horizon, if not a prondsed land, 
at least a few pronising approaches. 

Long range evaluation of atlministrator preparation should begin, not 
witli the preparation foi-, but the practice of sch.ool administration. Does tliat 
soui:d like a statement of the obvious, something eveT)'one knows and does 
nov;? ileriect on tiie legal problems caused for some private companies and 
public sdiool districts by their hiring and promotion policies. Hiey failed 
to base tlieir measures of job preparation on systenatic analyses of job 
requirements. M article in the Har/ard Educational Review points out that 
Title VII of tiie Civil Rights Act of 1964 is potential dynamite for those 
engaged in preparing and credcntialing people for jobs.^^ Suppose that 
a sdiool district seeking an assistant superintendent requires a doctoral 
degree for tiiat position. Suppose furttier that txie doctoral requirement 
disqualifies a disproportionate number of women, blacks, Spanish speaking, 
or other identifiable populations. Suppose finally, that the board of 
education cannot demonstrate by defensible research studies that tJiere exists 
a significant correlation betv^een the doctoral degree and job performance -- 
note that tlie burden of proof is on the district. The conclusion tliat would 
be drawn by the Equal Qitployment Opportunities Commission (EEOC) and, quite 
probably, by tlie courts is tliat the district may no longer require the degree 
as a qualification for that administrative position. 

We've already seen the problems of determini.ng measures of administrative 
success and evaluating preparation programs against that amorphous criterion. 
But even tlie EEOC and tlie courts do not demand criterion validity studies to 

1) Sheila Huff, "Credentialing by Tests or by Degrees: Title VII of tlie 
Civil Rights Act and Griggs v, Dule Power Co.,** Haivard Educational Revie w, 
44:2, May 1974. 
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legitimize training requirements. Carefully conducted content validation 
studies caJi provide a rationale tliat is less exact tlian tlie ideal of 
predictive validity correlations, but appears possxble to achieve. So, 
one begins evaluating administrator preparation programs by undertaking job 
descriptions and job analyses of administrative tasks. Hie more role-specific 
tliesc studies can be tlie better. Research over tlie next several years should 
scrutinize specific positions sucli as chairman, vice -principal, assistant 
superintendent for personnel; specific environments like elementary and 
secondary, inner-city and suburban schools, and so on. Researcii of this nature, 
incidentally, appears an ideal meeting ground for a university and a scliool 
system, since eacli stands to profit a great deal from the outcomes. 

Methodologies for conducting job analyses and identifying major tasks 
are familiar enough. Not surprisingly thie most reliable results came from 
combining and cross -validating data gathered from a variety of sources: 
these include existing job description, self-reports, and various kinds of 
observer reports. Certainly any researcher interested in undertaking such 
analyses would save himself a great deal of time by studying existing reports 
of administrative tasks, including in-basket studies and tediniques for 
identifying key administrative responsibilities like those recently described 
by Mclntyre.^^ 



2) Tlie classic exajiq^le of in-basket studies in sdiool administration is still 
Administrat.'.ve Performance and Personality , by Henpliill, Griffith and 
Frederiksen. (1962) Tiiat study received encouragement and support from the 
University Council on Educational Administration; UCEA later developed other 
series of in-basket studies. 

3) Sec Chapter six, "Administering and Inproving tlie Instructional Program" 

in Performance Objectives for School Principals by Culbertson, Plenson and Morri. 
(1974) . 
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Note that the recommended job analyses are not simply a first step 
in correlational studies wliicli con^are relative success in educational 
administration studies witli ••^elative success on a single dimension or a 
sum of on-tlie-job competencies. For reasons indicated earlier, t]\e likelihood 
of such predictive validity st. s yielding useful information is slim, if 
not none. Rather than determining a range of performance for each major 
administrative task, the investigator sijiply identifies important job 
elements, then determines whether the content of an administrator training 
program significantly overlaps some of those job requirements. Note the 
qualification: the university can do some things well, some badly, and some 
not at all. Moreover, defending a training program as the totality of experienci. 
needed to perform an amalgam of complex human activities is as sinple-minded 
as rejecting a measure of preparation because it relates "only" to one or 
more significant parts ratlier than the whole of the job. Let's assume that 
it is an isiportant task of principals to reconinend teacliers for retention, 
promotion, or dismissal, and that the principals' preparation includes training 
in how to arrive at valid, reliable judgements of teaclung behavior on the 
basis of observation and analysis. At least one element in the administrators* 
preparation is valid for one major element of the job. 

Of course, many relationsliips are not so obvious and -- one more time — 
many administrative tasks are not taught and may not be teachable in the 
university. 

If we've agreed that university programs can't do everything, for what 
part of the administrator's job can they and should they accept responsibility? 
One can find a bewildering variety of responses to these queries, but they 
tend to fall into tliree categories whicli are illustrated in a story first 
told, I relieve, by Cyril I^toule. In my probably multilated version, last 
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year's teadier graduates return to Swashbuckle University aiid during a 
colloqium witii their recent instructors complain tliat tliey were poorly 
prepared to enter tJie classroom. "Ycu didn't show us how to run a 
mimeograph maciiine, how to calm hysterical mothers or aggressive fatliers, 
and especially, you didn't tell us how to keep those kids from driving us 
up the wall every grisly day I" Five years later the same class returns 
and says to its erstwhile instractors, "you didn't prepare us properly: 
we should liave liad many more courses in our major fields, and fewer of tliose 
Mickey Mouse methods courses; the training in professional education 
should ixave empliasizcd understanding of pupil motivation, human relations 
and a lot more about the sociology of various population groups". Enter 
our surviving graduates some ten years later. Now the remnant of their 
university faculty is told, "you didn't come close to giving us wliat we 
need for teacliing. Wiliat we should liave had is a broad background in tlxe 
origins and great ideas of our civilization, and the background and tools to 
develop better goals for education". 

Since we're talking about long range evaluation, I suggest that the 
5th and lOtli year classes in tlie preceding story had sometliing to say to 
educational administration programs as well. Tlie general charge the university 
sliould accept is stated by March: 

The university has a distinctive area of coupe tence. It is the domaiPi 
of tlie intellect, (tlie university's advantage) is in providing 
the research basis for^ijitelligence and in teacliing tiie intellective 
skills of management. ^ 

4) Jan^s G. starch, "Analytical Skills and tlie University Training of Educationa, 
Administrators", Tne Journal of Educational Administration, 12:1, May, 1974, p. 2 
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Tlie article points out that maiiy inportajit qualities of an administrator 

liave quite modest intellectual content 

It nu/ be considorabZy more vital that tlie administrator be strong, 
or loving, or energetic, or sensitive, or cliarismatic, or a member 
of a particular social, etliiiic, or sexual group. We can recognize 
t]\e iiriportance of such taslis and tlie legitimcy and value of such 
attributes witliout accepting the proposition tliat tlie university should 
provide either the training or tlie certification for tiiem. ) 

Some quite defensible specifics of tliis intellectual role of tlie 
adr.iinistrator training program are spelled out in succeeding pages of 
tlie Marcli article. In term of the process of evaluating preparation 
programs, Marcli 's recommendations appear to be good candidates for satisfying 
tlie requirements of observable job relatedness and seem possible for 
the university to acconplish; of course, botli qualities must be verified 
by job and program studies. On the basis of existing research it seems 
probable tliat systematic job analyses will reveal major commonalities in the 
various administrative roles; tliis should be only a little less true for 
administrators in public or non- public schools, inner-outer- or sub-urban 
environments, at elementary or secondary levels. 

These common knowledge and skill requirements could be scrutinized for 
their intellectual bases and tlie results used to evaluate the relevancy 
of a university core training program to administrative practice. Tlie same 
process could apply to skills and understandings peculiar to different administr 
roles and environments, and tlie university programs' elective courses planned 
and evaluated accordingly. 

I suggest then, tliat the title of this paper might almost be reversed. 
We can only build long range evaluation into new models of administrator 
preparation if we build tlie new models upon carefully conducted analyses of 
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5) March, p. 28 
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iiiservice administrative behavior. Tine content validity of tlie preimration 
is then assured and long range evaluation sinply requires the updating of 
job analyses and their con^arison with current training programs. 

There are sonxj important issues tliis \vriter has cliosen to ignore 
because of the contraints of tinic, space, or courage. IVhen the relevancy of 
preparation programs to administrative practice lias been determined, we've 
not yet considered how well the prograin prepares its graduates. Tliis problem 
of internal program evaluation deserves its own full scale discussion. The 
job ajialyses approach appears to frustrate the academic's classic desire to 
train for v;Iiat should or will be, ratlier than for what is. But we nust walk 
before we can soar; preparation must be based on systematically identified 
administrative beliaviors with which the university is con^etent to deal. 
It probably doesn't matter liow well tlie faculty is teaching if tlieir instruction 
isn't demonstrably based on what administrators do now. 
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